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Contract for Manpower and Personnel Research and Studies IT (COMPRS-II) 
Annual Report-Year Four 


Introduction 


This report documents the first 4 years of a 5-year (1 base year and 4 option years) project 
to provide the U.S. Army Research Institute (ARI) non-personal, short- and medium-term 
scientific and technical support services in the solution of problems related to manpower and 
personnel. The program is referred to as the Contract for Manpower and Personnel Research and 
Studies II (COMPRS-II). HumRRO's primary responsibilities are to administer COMPRS-II for 
ARI under firm fixed-priced contracts by managing three inter-related tasks: (a) managing the 
COMPRS program in accordance with established operating procedures; (b) receiving and 
processing individual Statements of Tasks from ARI; and (c) managing, reporting progress on, 
and documenting completion of delivery orders. 


There are three programs under COMPRS-II. They are summarized below and are 
described in detail in Appendix A: 


e Quick Reaction (QR) Program - Intended to provide ARI responsive, short-term 
research or studies and analysis dealing with manpower and personnel issues for 
which ARI in-house capability is not available. Each of the QR Program delivery 
orders (DOs) shall be completed within a period of time specified in the DO, with the 
maximum allowable completion normally being within 12 months of the date of the 
DO. 


e Attitude and Opinion Survey (AOS) Program - Intended to give ARI the ability to 
conduct surveys to provide information for accession and force management decision- 
making. Each of the AOS Program DOs shall be completed within a period of time 
specified in the DO, with the maximum allowable completion normally being within 
12 months of the date of the DO or 18 months if OMB approval is required. 


e Medium-Term (MT) Program - Intended to give ARI the ability to conduct a 
limited number of research efforts or studies and analyses whose duration would not 
normally exceed 24 months after the contractor receives the DO. 


Summary of Activities 


Table 1 summarizes DO activity for the first 4 contract years. During this past year of the 
contract, 6 more DOs were initiated, including DO #0037 which continues the overall 
management of the contract vehicle. All but one of the remaining DOs were in the QR program. 


Table 1. Summary of Delivery Order Activity 


13 


Contract Administration 
Quick Reaction 


Number active DOs as of N/A N/A 15 12 
August 9, 2002 


Summaries for each DO initiated during the contract follow. Each summary provides the: 
following information: 


e The DO number and title. 
e The program area. 


e The DO contracting officer's representative (DO-COR), assistant DO-COR, if one is 
assigned, and the contractor's project director. . 


e The DO status (either ongoing or completed), to include the dates. 

e The project background. 

e The objectives of the project. 

e The key deliverables of the DO. 

e Findings/outcomes for completed DOs. 

e Report citations for completed DOs. 

These summaries are not intended to provide significant detail about each DO; that 


information can be provided by the DO-COR upon request. The summaries are intended to give a 
very brief overview of each effort as well as to provide a snapshot of the contract's activities. 


DO# 0001 Title: Year ] Contract Administration 


Program Area DO-COR: Dr. Judith Brooks 
QR DO-ACOR: 
Project Director: Dr. Deirdre Knapp 


Status: Completed (August 20, 1998-November 19, 1999 


Background: Providing information on manpower and personnel issues to Army decision-and policy-makers is often 
a complex, dynamic, multi-stage, iterative process. The accuracy and timeliness of information provided to decision- 
makers are of paramount importance in the quality of decisions and policies. Over the next decade, the U.S. Army 
will experience an increasing requirement to bring individuals into the Army who are trainable in a wide variety of 
skill areas. To meet and maintain its high quality manpower needs of the 1990s, the Army will have to develop and 
implement programs that allow it to locate, assess, assign, and use human resources more efficiently and effectively 
than it ever has before. As new Army policies are being developed to enhance the Army's ability to man the force, 
the Army needs programs of research and studies that will provide a quick response mechanism to gather and 
analyze data on the expected or actual short-term effectiveness of those policies. 

Scientific and technical support services are being used that lead to the development and implementation of 
programs of research and studies on the expected or actual effectiveness of Manpower, Personnel, and Training 
(MPT) programs. These efforts are part of ARI's MPT program to man the force by conducting research and studies 
to improve the Army's ability to recruit, identify, assess, classify, assign, lead, train, and maintain the personnel 
required for the Arm 
Project Objectives: The objectives of this delivery order are to administer the Contract for Manpower and 
Personnel Research and Studies II (COMPRS-II) for ARI under firm fixed-priced contracts by performing three 
inter-related tasks: (a) managing the COMPRS program in accordance with established operating procedures; (b) 
receiving and processing individual Statements of Tasks from ARI; and (c) managing, reporting progress on, and 
documenting completion of delivery orders. 
Key Deliverables: The following Delivery Orders were issued during Year 1: 

DO 0001 Year 1 Contract Administration 

DO 0002 Soldier Characteristics for the 21" Century: Phase II: Execution 

DO 0003 Transition and Training for the Total Army Transition Division Contract Quality Assurance Program 

DO 0004 Summary Report on Retention and Reacquisition of Knowledge and Skills 

DO 0005 Update LROC/SOC Database and Construct a SOC Longitudinal Database 

DO 0006 Initial Data Collection and Preliminary Analyses for Recruiting and Training Excellence (1* Rate) 

DO 0007 Pre-Implementation Research on the Assessment of Individual Motivation (AIM): Data Analysis 

DO 0008 Update of the U.S. Army Research Institute’s Officer Personnel Research Data Bases for 1997 and 

1998 

DO 0009 Training Base Attrition Study — I 

e DO 0010 Task Knowledge Commonality Model (TKCAM) Application for MOS 11B, MOS 11H, and MOS 
11M 

e DO 0011 Preparation of ARI Special Report on the Enlisted Personnel Allocation System (EPAS) 

e DO 0012 Data Collection Support for TRADOC-99-CEP-0101, Manned and Unmanned Aerial Platform 
Operations on the Digitized Battlefield (Air Maneuver Recon Teams) 

¢ DO0013 Automated Data Collection System Modification and Development 

Findings/Outcomes: n/a 

Report Citations: 

Human Resources Research Organization. (1999). COMPRS-I] Year ] — Standard Operating Procedures (SOP) 

(Study Note 99-01). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. 


Human Resources Research Organization (2000). Contract for Manpower and Personnel Research and Studies II 
(COMPRS-I]) Annual Report — Year 1 (ARI Research Note 2000-03). Alexandria, VA: U.S. Army Research Institute 
for the Behavioral and Social Sciences. 


DO# 0002 Title: Soldier Characteristics for the 21 Century: Phase II: Execution 


Program Area DO-COR: Dr. Michael Rumsey 
QR _X_ DO-ACOR: 
Project Director: Dr. Laura Ford 


Status: Completed (September 13, 1998 — September 30, 1999 


Background: On 21 March 1997, MG Arthur T. Dean, Director of Military Personnel Management, Deputy Chief 
of Staff for Personnel, requested that ARI “immediately undertake a ‘quick study’ to determine the desired - 
characteristics, qualities and aptitudes for the enlistee of the 21* century.” ARI responded with a two-part program, 
known as Soldier21. The first part, involving a review and summary of available information supplemented by a 
“target of opportunity” data collection, was completed and reported to MG Dean in January 1998. The second part 
was a more comprehensive effort involving the collection of new data. In May 1998, a contract effort was initiated to 
develop the methodology for this second part and to examine how the execution of this methodology and the 
execution of a related project, 21** Century NCOs (NCO21), could be merged for optimum efficiency. 

This study addressed two separate issues for the future Army: determining the most important knowledges, skills, 
and attributes (KSAs) for soldier selection (Soldier21) and identifying the most important KSAs for promotion to 
and within the noncommissioned officer (NCO) ranks (NCO21). The future Army eras that were explored were 
Army XXI (2000-2010) and the Army After 2010 (2010-2025). The Soldier21 study was an attempt to anticipate 
changes that should be considered for the Army selection and classification systems so as to select enlisted applicants 
who can better meet the task demands of the Army in the 21* century. The NCO portion of the project examined the 
battlefield of the future and how it will require NCOs who can train forces to operate effectively in digital 
environments with increased mission diversity, fewer soldiers, and numerous organizational and social changes. The 
NCO promotion system for the 21“ century will need new measurement procedures to evaluate the full scope of 
performance needed to successfully meet future job requirements. To do so, jobs, units, and missions that are 
indicative of future conditions were examined and analyzed in order to outline the KSAs that could be utilized in a 
future performance-based promotion system. In other words, this project explored the factors that will affect jobs in 
the future. In turn, the KSAs that will be needed to succeed in the Army of the future were identified. Work on the 
continuation of the NCO21 portion of this research am has continued under Delivery Order #15. 
Project Objectives: The objectives for this delivery order were to identify soldier requirements in two future Army 
eras in terms of (a) the required characteristics to effectively perform the job of a first term enlisted soldier, and (b) 
the individual attributes to effectively perform at three levels of NCO jobs — Junior NCOs (Corporal E4-E5), Mid- 
level NCOs (E6-E7), and Senior NCOs (E8-E9). Another objective was to identify potential alternative measures for 
the attributes identified as critical in the 21" century Army. 

Key Deliverables: Key deliverables for this effort consisted of (a) a summary of future conditions relevant to Army 
jobs, (b) a summary of forecasted job demands, and (c) a final technical report. 
Findings/Outcomes: The KSAs found to be potentially relevant for future selection (first tour soldiers) and 
promotion (NCOs) purposes were identified for five target groups: (1) For AXXI first tour soldiers the four most 
important KSAs were General Cognitive Aptitude, Conscientiousness/Dependability, Reading Skill, and Working 
Memory; (2) For AXXI Junior NCOs the four most important KSAs were Conscientiousness/Dependability, 
MOS/Occupation-Specific Knowledge and Skill, General Cognitive Aptitude, and Motivating and Leading Others; 
(3) For AXX]I Mid-level NCOs the four most important KSAs were Judgment and Decision Making; General 
Cognitive Aptitude; Directing, Monitoring and Supervising Others; and Motivating and Leading Others; (4) For 
AXXI Senior NCOs the four most important KSAs were General Cognitive Aptitude, Motivating and Leading 
Others, Judgment and Decision Making, and Concern for Soldier Quality of Life; (5) For AA2010 Battle Force 
NCOs the three most important KSAs were Judgment and Decision Making, General Cognitive Aptitude, and 
Knowledge of Battlefield Function Integration. 

One difference between KSAs for selection and KSAs for NCO promotion is that additional KSA information is 
potentially available for promotion decisions. That is, various aspects of an individual’s current and past 
performance could be assessed and serve as predictors of future performance. 
Report Citations: Ford, L. A., Campbell, R. C., Campbell, J. P., Knapp, D. J, & Walker, C. B. (2000). 2/st Century 
Soldiers and Noncommissioned Officers: Critical Predictors of Performance (ARI Technical Report 1102). 
Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. 


Title: Transition and Training for the Total Army Transition Division Contract Quality 
Assurance Prog 
DO-COR: Ms. Susan Harvey, ASA (M & RA [HR XXI]) 
DO-ACOR: Ms. Naomi Lynch, ASA (M & RA [HR XXI]) 
Project Director: Mr. Eric Wetzel 


DO# 0003 


Program Area 
QR 
AOS 
MT xX 


Status: Completed (September 11, 1998 — June 30, 2000 


Background: HumRRO has a long history with the Transition Acquisition Branch (TAB) of the Total Army 
Transition Division (TATD) which includes support of quality assurance (QA) program and management 
information system (MIS) development.These two programs are critical to an organization such as the TAB, which 
monitors a five billion dollar indefinite quantities contract QC) providing human resources support services to the’ 
Army.and other federal government agencies. On 23 February 1999, TAB was transferred from PERSCOM to the 
Assistant Secretary of the Army for Manpower and Reserve Affairs (ASA [M&RA)]). The organization formerly 
known as TAB is now the Human Resources XXI office (HR XXI). Under ASA (M&RA), the market and potential 
uses of the IQC have expanded and the possibility of the HR XX]I office operating under a cost reimbursable format 
was being considered. These organizational and potential functional changes necessitated modifications to both the 
QA program and MIS, along with the development of a business and marketing plan for HR XXI’s use in a cost 
reimbursable environment. 

Project Objectives: The objectives of this delivery order were to provide HR XX] with the necessary spon to 
make a smooth transition to their new organizational structure, and to lay the ground work for their expanded 
mission while updating 
Key Deliverables: The final deliverables for this project included a revised QA program, as well as MIS and 
business and marketing plans for the re-focused organization. 
Findings/Outcomes: A 2-volume final report updating the previously developed QA and MIS program 
documentation was delivered directly to the COR on September 24, 1999. These volumes were deemed ~ 
“Procurement Sensitive — For Official Use Only” by the COR and marked accordingly. The Business and Marketing 
Plans were delivered directly to the COR by HumRRO consultants and subcontractors. 


Report Citations: Due to the sensitive nature of these documents, no report citations were made. 


Title: Summary Report on Retention and Reacquisition of Knowledge and Skills 
DO-COR: Dr. Robert Wisher 
DO-ACOR: 
Project Director: Dr. Deirdre Knapp (with Dr. John Ellis of K. Ellis Human Resources 

MT _____ Services & Consulting) 

DO Summar 

Background: ARI required assistance from an expert in the field of learning and memory to prepare a summary 
review of research on skill retention and reacquisition. The summary review, approximately 20 pages in length, was 
to cover research done by ARI and other military laboratories in remembering skills taught in the classroom and field 
for periods of up to several years. 
Project Objectives: The objective of this effort was to provide a non-technical document with supporting 
photographs and graphic material to inform the military reader of the importance and value of research on skill 
retention and reacquisition. 
Findings/Outcomes: The report has been completed and published as an ARI Special Report. 
Report Citations: Wisher, R.A., Sabol, M.A., & Ellis, J.A. (1999). Staying Sharp: Retention of Military Knowledge 
and Skills (ARI Special Report 39). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social 
Sciences. 


DO# 0004 


Program Area 
QR _X_ 


DO# 0005 Title: Update LROC/SOC Database and Construct a SOC Longitudinal Database 


Program Area DO-COR: Ms. June T. Jones 
DO-ACOR: 
Project Director: Dr. Gina Medsker 


Status: Completed (September 25, 1998 — August 31, 1999 


Background: ARI has been conducting surveys of officer attitudes for several years, including the Longitudinal 
Research on Officer Careers (LROC) surveys in 1988, 1989, 1990, and 1992, and the Survey of Officer Careers 
(SOC) in 1996 and 1998. The purpose of this effort was to produce both a Longitudinal Database and a Trend 
Database for ARI. The databases will be used to continue monitoring Army officers on issues of concern to the Army 
and the officer corps. Current SOC results, in conjunction with previous SOC and LROC results, will help the Army 
understand what happens to officers during their careers and the types and extent of impacts that events, behaviors, 
and attitudes/opinions have on officers’ career plans. Results of the 1998 SOC will also help the Army track officer 
reactions to the new Officer Personnel Management System XXI (OPMS XXI). 
Project Objectives: The objectives of this project were to provide (a) a fully documented SOC Longitudinal 
Database that includes respondents who have data for both 1996 and 1998 SOC surveys, (b) a SOC Trend Database 
which adds the 1998 SOC Cross-Sectional Database to the existing LROC/SOC database, and (c) a set of charts 
displaying the results for both the SOC Longitudinal and Trend Databases. 
Key Deliverables: Key deliverables include an edited 1998 SOC raw data file and final editing program, the 1996- 
98 SOC Longitudinal Database and codebook, the SOC-LROC Trend Database and codebook, and charts for all 
items that appeared in both the 1996 and 1998 SOC based on the 1996-1998 Longitudinal Database. 
Findings/Outcomes: Electronic data sets, codebooks, and briefing charts were provided to ARI in accordance with 
the contract deliverable requirements. 


Report Citations: n/a 


Program Area DO-COR: Dr. Trueman Tremble 
QR _X_ DO-ACOR: 
Project Director: Dr. Bill Strickland 


Status: Completed (September 28, 1998 — December 31, 1999 


Background: In 1996, the Office of the Assistant Secretary of the Army (Manpower and Reserve Affairs; ASA 
M&RA) asked ARI to draft a broad-based proposal for carrying out a five- to six-year comprehensive, integrated 
research program examining the multiple causes of first-term Army enlisted attrition. This proposal suggests that 
variables influencing attrition include personal variables (e.g., expectations, values, and background), organizational 
variables (e.g., culture and climate within the Army), and extra-organizational variables (e.g., attitudes of significant 
others, opportunities for civilian employment). When considered in combination, these variables determine the 
individual's “fit” within the organization and the likelihood that he or she will be successful in the Army. 

In support of this long-term effort, ARI developed a multi-phased project. Phase I of the project began in August 
1997 and was completed in January 1998. The objective for that initial phase was to develop and assess a prototype 
database for tracking first-term enlisted personnel attrition. The results from Phase I established the methodology for 
developing comprehensive attrition databases for subsequent phases. 

Phase II of the project began in June 1998 and ended in October 1999. Phase II had three primary objectives: (a) 
design and plan the overall five- to six-year attrition effort which incorporates both longitudinal and concurrent 
designs; (b) develop comprehensive sampling plans for both the longitudinal and concurrent designs; and (c) 
develop, field test, and gain approval for appropriate surveys and other measures in preparation for the data 
collection phases. 

This delivery order constituted Phase Il] of the attrition program. The objectives of Phase III were to execute the 
initial data collection phase of the study and to conduct preliminary analyses of the data. Data from a subset of fiscal 
year 1999 soldiers entering training served as a longitudinal cohort to be followed through their first-term of 
enlistment. Concurrent samples of soldiers in various stages of their first-term were collected and used for 
comparison. 

Project Objectives: There were two objectives of this effort: 

1. To execute the initial data collection phase of the attrition research program using the research measures, data 
collection plan, and sampling plan developed in Phase II of the project. 

2. To conduct preliminary analyses of the data collected during this phase. 

Findings/Outcomes: Administration of the Soldier Reception Survey was completed in August, while the End of 

Training and Exit Surveys were completed in December. Preliminary analyses of scales within the surveys indicate 

that they will likely be useful for subsequent data modeling efforts. 

Report Citations: Sipes, D.E., & Sadacca, R. (2000). Initial data collection and preliminary analyses for research 

on first-term soldier attrition and management (Project First Term) (ARI Research Note 2000-10). Alexandria, VA: 

U.S. Army Research Institute for the Behavioral and Social Sciences. 


Title: Pre-Implementation Research on the Assessment of Individual Motivation (AIM): 
DO# 0007 F 
Data Analysis 


Program Area DO-COR: Dr. Mark Young 


QR _X_ DO-ACOR: Dr. Michael Rumsey 
AOS Project Director: Dr. Brian Waters 
MT 


Status: Completed (September 28, 1998 — November 30, 1999 


Background: Over the past decade, there has been a resurgence of interest in using personality (or temperament) 
assessments for personnel decisions. The military has been no exception. The Assessment of Background and Life 
Experiences (ABLE) was designed to assess six personality constructs that were identified as having a potential to 
be predictive of job-related criteria. Research indicated that, while the ABLE had predictive validity for certain 
aspects of job performance and for first-term attrition, it was also susceptible to the effects of faking and coaching. 
Also, while evidence of the predictive validity of ABLE was found for various criteria in the standard instruction 
condition, the validity estimates were near zero for the same criteria in the faking and coaching conditions. At least 
in part on the basis of these results, the ABLE was not operationally implemented in the Army. 

ARI developed the Assessment of Individual Motivation (AIM) in an effort to build an assessment tool that 
would provide scores for the constructs measured by ABLE, but in a way that was resistant to the effects of faking 
and coaching. Preliminary research using the AIM indicated that the instrument was predictive of first-term attrition 
and was less susceptible to the effects of faking and coaching than the ABLE. These positive preliminary findings - 
piqued the Army’s interest in using the AIM as a pre-enlistment screen for attrition, and a program of research was 
initiated to (a) determine whether the use of AIM for pre-enlistment screening would be viable for the Army and (b) 
remove obstacles to its implementation. 
This delivery order extended the AIM development work be 
Project Objectives: The project objectives were as follows: 
Create the database needed for carrying out AIM Phase I research. 

Determine the validity of the existing AIM against 3-month attrition. 

Refine and evaluate two initial AIM alternate forms. 

Create and evaluate revised AIM alternate forms. 

Conduct research to establish testing policies for those applicants who have high scores on the faking scale or 
who score below the AIM cut score. 

. _ Assess the potential for adverse impact in the AIM. 
Key Deliverables: Key project deliverables were: 
1. SAS dataset and code book 

2. Alternate AIM forms 

3. Plans for faking policy research and for policy research on applicants who fail AIM 
4. Final report 
s/Outcomes: The Army implemented the AIM as a screen for Cate 
Report Citations: 

Heggestad, E. D., Young, M. C., Strickland, W. G., & Rumsey, M. G. (1999). The Assessment of Individual 
Motivation: Evaluation of validity and development of alternate forms (FR-WATSD-99-66). Alexandria, VA: 
Human Resources Research Organization. (not for public release) 


un under Delivery Order # 75 of COMPRS-I. 


iG) bo 


ory II applicants in FY 2000. 


Heggestad, E.D, Lightfoot, M.A., & Waters, B.K. (1999). Pre-implementation research on the assessment of 
individual motivation (AIM). Phase I: Item development (HumRRO Final Report FR-WATSD-99-22). Alexandria, 
VA: Human Resources Research Organization. (not for public release) 


Young, M.C. Heggestad, E.D., & Nason, E. (1999, September). Assessment of Individual Motivation (AIM) pre- 
implementation research and implementation plans. In L. Looper, Chair, Screening, selection, attrition, and 
posium conducted at the meeting of the Military Operations Research Society, Alexandria, VA. 


retention. S 


Program Area DO-COR : Dr. Peter M. Greenston 
QR X_ DO-ACOR: 
Project Director: Ms. Lori Ramsey (Fu Associates) 


Status: Completed (September 28, 1998 - September 15 1999 


Background: ARI’s Selection and Assignment Research Unit (SARU) required an update to a group of U.S. Army 
personnel databases that could be used as a ready source of career history information for analysis of career path 
issues such as attrition, retention, and promotion. In addition, the databases could serve as a complement to survey 
data collected to study leader development, organizational commitment, and other issues. In order to satisfy these 
research requirements, it was necessary to collect, process, and add current personnel and training data to the Officer 
Longitudinal Research Data Base (OLRDB) and the Officer Educational Testing Data Base (OSETDB). The 
OLRDB is constructed primarily of officer personnel data from the Officer Master File (OMF) and separation 
history from the Separation Officer Master File (SOMF). The OSETDB contains officer personnel data from the 
OMF and SOMF and academic aptitude measures in the form of standardized scores collected from the Educational 
Testing Service and the American College Testing 

Project Objectives: The objective of this project was to collect annual source data files for 1997 and 1998 and to 
update the OLRDB and the OSETDB with officer personnel data maintained by Personnel Command (PERSCOM) 
and the Defense Manpower Data Center (DMDC). In addition; modifications were made to the existing update 
process to develop procedures that are Y2K compliant. 

Key Deliverables: Key project deliverables were (a) a 1997 and 1998 version of the OLRDB Longitudinal and Core 
data sets on computer tape, (b) a 1997 and 1998 version of the OSETDB on computer tape, (c) a final study report 
for the 1997 and 1998 OLRDB and OSETDB data sets, and (d) a CD-ROM copy of the OLRDB and OSETDB 
Longitudinal data sets. 

Findings/Outcomes: In addition to delivery of the actual data sets, the final report produced in this project describes 
the procedures performed to add 1997 and 1998 personne! data to the Longitudinal and Core OLRDB data sets. 
Report Citations: 

Ramsey, L.J., & Meade, K.F. (1999). Update of U.S. Army Research Institute’s Officer Personnel Research Data 
Bases for 1997 and 1998. FU Associates/HumRRO contract final report. 
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DO# 0009 Title: Training Base Attrition Study — I 


Program Area DO-COR: Dr. Trueman Tremble 
QR _X_ DO-ACOR: 
Project Director: Dr. Bill Strickland 


Status: Completed (February 11, 1999 — October 31, 2000 


Background: In November 1998, the Chief of Staff of the Army (CSA) directed the Deputy Chief of Staff for 
Personnel (DCSPER) to conduct a study to determine why soldiers separate from the Army while at the initial entry 
training (IET) base. The directive called for study of the soldiers who leave service in calendar year (CY) 1999. 

When ARI received this tasking, it had already initiated an effort sponsored by the Assistant Secretary of the 
Army, Manpower and Reserve Affairs (ASA (M&RA)) to study first-term attrition issues known as "First Term 
Recruiting and Training Excellence" (or First Rate, see DO#6). The objective of First Rate is to determine the causes 
of attrition during the first term of enlistment. Central to achievement of First Rate's objective is the collection of 
data on a cohort of first-term soldiers over the course of the initial enlistment period, beginning with entry at Army 
reception battalions and ending with exit from service or term completion. 

The plans underway for First Rate provide the start for a timely response to the CSA tasking. The types of data 
obtained through the established First Rate procedures, however, reflect only part of the attrition equation. That is, 
they represent reasons and explanatory factors for attrition as perceived by the soldiers, especially soldiers who are 
separating. The other part of the equation reflects the views of the organization. Response to the CSA request will 
include assembly of official views on the soldiers who leave service. Linking soldiers' own views with official views | - 
may help clarify reasons for attrition and suggest strategies for controlling attrition rates. 

The purpose of this effort was to obtain the information for a focused and timely response to the CSA tasking. ~ 
The work added to the sample of incoming soldiers being studied while in training base in CY99. In addition, it 
involved the collection and use of information not originally planned for First Rate — specifically, personnel data 
from official records. 
Project Objectives: The objective of this delivery order was to determine why soldiers leave the Army while in the 
base. 
Key Deliverables: Key project deliverables consisted of: 
1. Two expanded progress reports. 
2. Briefing materials supporting the expanded progress reports, for ARI use in presenting updates to the DCSPER. 
3. A final Technical Report. 
4. Briefing materials describing the study’s findings, suitable for presentation to the Chief of Staff. 
Findings/Outcomes: Correlates of attrition were consistent with previous research: education level, AFQT category, 
gender, race/ethnicity, and MOS were reliably related to attrition. Survey data provided some improvement in the 
ability of the statistical model to predict which soldiers would attrit. Early ratings in Basic Combat Training by drill 
sergeants indicated discernable differences between non-attritees and attritees on both objective measures of physical 
fitness and subjective ratings of core values, motivation, and discipline. The results of the project should prove 
useful for identifying soldiers who are at risk for early attrition, in order to implement appropriate interventions to 
prevent such an outcome. 
Report Citations: Sipes, D.E. (Sunny), Strickland, W.J., Laurence, J.H., DiFazio, A.S., & Wetzel, E.S. (2000). 
Training base attrition: Analyses and findings (FR-00-38). Alexandria, VA: Human Resources Research 
Organization. 


1] 


DO-COR: Mr. Bill Badey 
DO-ACOR: 
Project Director: Dr. Bill Strickland (with Mr. Alan Akman of Akman Associates) 


Status: Completed (February 18, 1999 — September 30, 1999 


Background: Occupational mergers or shred-outs require updates to officer and enlisted individual and advanced 
technical task training. AR 611-1, Military Occupational Classification Structure and Implementation (Sep 97), 
requires documentation of occupational restructures as well as updates to job descriptions contained in various Army 
Regulations and Pamphlets. The Task Knowledge Commonality Model (TKCAM) is a tool designed specifically to 
allow users to analyze the feasibility of occupational mergers or shred-outs, to define new occupational structures, 
and to assist in the initial identification of tasks which can be considered critical to individual and unit survival on 
the battlefield. 

The Commandant, United States Army Infantry School (USAJS), Fort Benning, GA, is considering the merger of 
MOS 11B (Infantryman), MOS 11H (Heavy Antiarmor Weapons Infantryman), and MOS 11M (Fighting Vehicle 
Infantryman) to improve the efficiency of field combat operations. He requested ARI’s assistance in applying the 
TKCAM methodolog aITyi 
Project Objectives: The project had three objectives: 

1. Present a comprehensive course of instruction on TKCAM principles and practices at the USAIS. 

2. Validate TKCAM user findings made by the USAIS. 

3. Collect and provide lessons learned and proposed changes to improve the TKCAM USER’ S MANUAL 
design and processes. 
Key Deliverables: Key deliverables were as follows: 

1. Briefing to the Office of Infantry Proponency 

2. TKCAM Summary Report 
3. Observations and Lessons Learned Letter Report 
Findings/Outcomes: As noted by MG Ernst, CG USAIC, in a Certificate of Appreciation, “Based upon . . the Task 
Knowledges Commonality Analysis Method, the Infantry is now in a position to ape with facts on the question of 
MOS restructure feasibility.” 


Report Citations: n/a 


Program Area 
QR _X_ 
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DO# 0011 Title: Preparation of ARI Special Report on the Enlisted Personnel Allocation System 
(EPAS) 


Program Area DO-COR: Dr. Peter Greenston 
QR _X_ DO-ACOR: 
Project Director: Dr. Mary Ann Lightfoot 


MT 
Status: Completed (April 13, 1998 — April 30, 1999 : 
DO Summar 


Background: ARI required a description of EPAS and how it fits within Army personnel classification research, 
development, and operational systems. The special report should be for an audience of Army managers—amilitary 
and civilian, with diverse backgrounds. The “story” of EPAS includes what it is, how it works, what it will do for the 
Army when it is operational, and how it can be enhanced in the near future to provide even greater utility and 
efficiency. EPAS is an algorithm, implemented by linear programming software, which optimizes the Army’s 
enlisted personnel classification system, while accounting for realistic constraints. EPAS was designed, developed, 
and tested by ARI over 15 years. It is currently being installed in the Army’s operational recruit selection and 
classification mainframe software called REQUEST. 
Project Objectives: The objective of this project was to prepare an ARI Special Report that describes EPAS 
development and its role in improving classification in the Army. The audience for this special report is Army 
management. 


Ke Deliverables: The key deliverable was an ARI Special Report. 
Findings/Outcomes: n/a 


Report Citations: 
Lightfoot, M.A., & Ramsberger, P.F. (2000). Matching Recruits to Jobs: The Enlisted Personnel Allocation System 
(EPAS) (ARI Special Report 41). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social 


Sciences. 
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DO# 0012 Title: Data Collection Support for TRADOC-99-CEP-0101, Manned and Unmanned Aerial 
Platform Operations on the Digitized Battlefield (Air Maneuver Recon Teams 

Program Area DO-COR: Dr. William Howse 

QR _X_ DO-ACOR: 
Project Director: Dr. Deirdre J. Knapp (with Mr. John Woods of Carmel Applied 
Technologies, Incorporated 


‘Status: 1s: Completed (August 5, 1999 — February 28, 2000 


Background: The Air Maneuver Battle Lab (AMBL) is conducting TRADOC-99-CEP-0101, Manned and 
Unmanned Aerial Platform Operations on the Digitized Battlefield. It is the third in a series of investigations on this 
subject under the Training and Doctrine Command (TRADOC) Concept Experimentation Program. This effort is 
commonly referred to as MUM-III. The ARI Rotary Wing Aviation Research Unit (ARI-RWARU) provided support 
for MUM-I (TRADOC-CEP-97-0101) and MUM-II (TRADOC-CEP-98-0104), and is providing support for MUM- 
II]. Experimentation is being conducted by means of operation of interactive virtual simulations of manned and - 
unmanned rotary wing aircraft in a Distributed Interactive Simulation (DIS) synthetic environment. Major simulation 
systems anticipated for use in MUM-III include the Advanced Tactical Combat Model (ATCOM), the Comanche 
Portable Cockpit (CPC), and the Rapid Prototyping Mission Simulator (RPMS). The effort explores the potential 
increases in operational effectiveness that can be gained through cooperative teaming of dissimilar systems to 
accomplish reconnaissance missions. 

Although most support for this effort is provided by ARI personnel, additional manpower was required to operate 
and monitor the automated data collection systems during the execution of simulation exercises and to perform data 
reduction functions during and after simulation exercises. It was imperative that data reduction be accurately 
performed during and at the close of each simulated mission and immediately following the data collection phase of 
the project. 

Project Objectives: The objective of this delivery order was to ensure correct and complete collection of data from 
a real-time virtual simulation network and to perform data reduction processes as rapidly as possible. 


Key Deliverables: Key deliverables were a summary data archive and Measures of Performance (MOPs 


Findings/Outcomes: n/a 
Report Citations: n/a 
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DO# 0013 Title: Automated Data Collection System Modification and Development 


Program Area DO-COR: Dr. William Howse 


QR _X_ DO-ACOR: 
AOS Project Director: Dr. Deirdre J. Knapp (with Dr. David Skipper of Bevilacqua Research 
MT Corporation 


Status: Completed (August 5, 1999 — February 28, 2000 


Background: The U.S. Army Research Institute Rotary Wing Aviation Research Unit (ARI/RWARU) at Ft. Rucker 
Alabama has been tasked to support MUM II] exercises at the Aviation Battle laboratory. This support includes the 

collection and analysis of human factors data related to soldier performance during the exercises. ARI plans to use 
the DCAT automated data collection software to help perform this task. The AEMoS software has been used in the 
past, however, and several of the capabilities of AEMoS must be integrated with the new DCAT software to allow 
comprehensive data collection and analysis capability. : 

Project Objectives: The objective of this effort was to combine features of the AEMoS and DCAT data collection 
systems for use in support of the MUM-III exercises. 


Key Deliverables: Key deliverables were the software source and executable code. 
‘Findings/Outcomes: n/a 
Report Citations: n/a 
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DO# 0014 Title: Automation of Army’s Basic Skills Program 


Program Area DO-COR: Ms. Lynn Steed (PERSCOM) 


QR DO-ACOR: Ms. Dee Flynn (PERSCOM) 
AOS Project Director: Dr. Laura Ford 
MT xX 


Status: Completed (October 4, 1999 — March 31, 2002 


Background: The leadership of the Army directed that the Army’s Basic Skills program be automated, 
standardized, and deployable. The approach for automating the program was be to identify commercial-off-the-shelf 
(COTS) software that contains not only the subjects addressed in the current FAST curriculum (reading, writing, and 
mathematics) but also science, computer knowledge, skilis LA ag for military service (such as problem solving 
and following 
Project Objectives: The overarching objective for this project was to recommend effective and efficient computer- 
based instruction (CBI) packages for Basic Skills and ESL skills in two different environments: Education Centers 

on Army posts and at deployment sites. To achieve this objective, the plan was to: 


Identify up to three Basic Skills COTS software packages that meet program specifications (e.g., pre- 
assessment, prescription, instruction, practice, and post-test) and are accompanied by a suitable MIS (to manage, 
deliver, assess, and monitor student progress). 


e Identify up to three ESL COTS software packages that meet program specifications. 


e Design and execute a 12-month pilot test of the COTS packages in two types of conditions: (1) Education 
Centers at three Army posts in the continental United States (CONUS) and (2) up to three deployment sites 
outside the continental United States (OQCONUS). 

e Purchase and install requisite hardware and software at CONUS Army locations for the pilot tests, including 
hardware/software for deployed locations. 

e Recommend the most effective COTS package for Army Basic Skills and ESL training, based on pilot test 
results from the Education Center sites. 


e Provide feedback on the feasibility and logistics of Basic Skills and ESL training for soldiers on deployment. 


measurement instruments. 


Research current, adult-oriented, learning 
Key Deliverables: 

(1) Comprehensive recommendation report for Basic Skills and ESL COTS software. 
(2) Final Report on results of the pilot test of Basic Skills and ESL COTS software. 
Findings/Outcomes: The results of the basic skills trials showed that the three basic skills COTS products can 
facilitate the automation and standardization of the Army’ basic skills program. Lifetime Library was ranked first of 
the three products tested as it yielded a significantly higher gain on the Test of Adult Basic Education (TABE) in 
mathematics and a slightly higher, though not significant, gain in reading. However, factors that were not taken into 
consideration in this recommendation, such as Internet capability and cost, may override the TABE gain when the 
Army decides which product to purchase. For the ESL study, it was determined that, at the present time, there is not 
a strong need for this type of computer-based training. More research may be required to assess the Army’s 
instructional requirements for soldiers with limited English proficiency (LEP). Finally, sending laptop computers 
overseas with deploying soldiers appears to work best when an officer or senior noncommissioned officer serves as 
an “educational supervisor” and oversees the usage of the laptops. In general, soldiers were very positive about the 
to study basic skills during deployment missions. 
Report Citations: 

Ford, L.A., Campbell, R. C., & Gribben, M. A. (2002). Automating and Standardizing Basic Skills Training: Results 
Comparative Trials of Commercial-Off-the-Shelf Software (FR-0205). Alexandria, VA: Human Resources Research 
Organization. 


Ford, L. A., Gribbens, M. A, & Campbell, R. C. (2000). Evaluation and recommendation of commercial-off-the-shelf 
basic skills and English-as-a-second-language software programs (IR-00-47). Alexandria, VA: Human Resources 
Research Organization. 
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DO# 0015 Title: NCO Characteristics for the 21" Century: Assessment and Validation 


Program Area DO-COR: Dr. Tonia Heffner 
QR DO-ACOR: 

AOS Project Director: Dr. Deirdre J. Knapp 
MTX 


Status: Ongoing (September 30, 1999 — December 31, 2002 


Background: The noncommissioned officer (NCO) corps must ensure that the U.S. Army remains trained and ready 
today and adapts to meet the challenges of the 21* century (GEN Reimer, Chief of Staff of the Army, 1996). These 
challenges include more complex technology, an increased diversity of missions, a downsized Army, and 
organizational and social changes. The battlefield of the future requires soldiers who can effectively operate in 
digitized environments and meet an increased diversity of missions. 

This effort addresses NCO promotion, a critical component of an effective personnel management system for the 
future NCO corps. The current promotion system does not fully assess an individual’s potential to meet current job 
demands, much less those that will be required as we move further into the 21* century. 

This is the third phase of a three-phase effort undertaken by the U.S. Army Research Institute for the Behavioral 
and Social Sciences (ARI). The first phase developed a plan for execution of Phase II. The second phase involved 
the identification of a set of critical 21 century NCO knowledges, skills, and aptitudes (KSAs) for two time periods 
(2000-2010 and 2010-2025), based on a projected set of future job demands. Jn the third phase, predictor measures 
of these critical KSAs will be identified and validated against performance measures relevant to future NCO 
performance. Indicators linked to these measures of future success will provide the knowledge base and foundation 
for an improved NCO performance system. 

Project Objectives: The purpose of this effort is to lay the knowledge base for a promotion system geared to the 
needs of the 21" century. More specifically, the objectives are to (a) develop and/or identify measures of the KSAs 
needed to perform effectively the NCO job in two separate time periods (2000-2010, 2010-2025), and for multiple 
NCO levels; (b) develop performance measures that will serve as criteria for the KSA measures identified or 
developed; and (c) validate the KSA measures against the performance measures. 
Key Deliverables: Key project deliverables include KSA and criterion measures, including a report describing their 
development. There will be a final report that reports the methodology and findings associated with the validation of 
the KSA measures. There will also be a marketing-oriented user community report and a non-technical 
recommendations report. 
Findings/Outcomes: Predictor (KSA) and criterion measures were developed and field tested at three Army 
installations. The predictor measures include a semi-structured interview, an activity/accomplishment checklist, and a 
written situational judgment test. Supervisor ratings are the primary criterion measure — including ratings of current 
performance and ratings of expected performance under future Army conditions. Validation data were collected at 
seven Army installations during the period April through August 2001. Analyses have been conducted and reported 
to Army sponsor representatives. A technical report documenting the validation is being prepared. The development 
of recommendations is in progress and will be documented in a separate report. Project staff have also written a 
special report to describe the NCO21 project to the Army user community. 

Report Citations: 

Knapp, D.J., Burnfield, J.L., Sager, C.E., Waugh, G.W., Campbell, J.P., Reeve, C.L., Campbell, R.C., White, L.A., 
and Heffner, T.S. (2002). Development of the Predictor and Criterion Measures for the NCO21 Research Program 
(ARI Technical Report 1128). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social 
Sciences. 


Campbell, R.C., & Knapp, D.J. (2002). Selection for Leadership: Transforming NCO Promotion (ARI Special 
Report). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. 


DO# 0016 Title: Year 2 Contract Administration 


Program Area DO-COR: Dr. Judith Brooks 
QR DO-ACOR: 
Project Director: Dr. Deirdre Knapp 


Status: Completed (October 5, 1999-November 4, 2000 


Background: Providing information on manpower and personnel issues to Army decision-and policy-makers is often 
a complex, dynamic, multi-stage, iterative process. The accuracy and timeliness of information provided to decision- 
makers are of paramount importance in the quality of decisions and policies. Over the next decade, the U.S. Army 
will experience an increasing requirement to bring individuals into the Army who are trainable in a wide variety of 
skill areas. To meet and maintain its high quality manpower needs of the new millenium, the Army will have to 
develop and implement programs that allow it to locate, assess, assign, and use human resources more efficiently and 
effectively than it ever has before. As new Army policies are being developed to enhance the Army's ability to man 
the force, the Army needs programs of research and studies that will provide a quick response mechanism to gather 
and analyze data on the expected or actual short-term effectiveness of those policies. 

Scientific and technical support services are being used that lead to the development and implementation of 
programs of research and studies on the expected or actual effectiveness of Manpower, Personnel, and Training 
(MPT) programs. These efforts are part of ARI's MPT program to man the force by conducting research and studies 
to improve the Army's ability to recruit, identify, assess, classify, assign, lead, train, and maintain the personnel . 
required for the Army. 
Project Objectives: The objectives of this delivery order are to administer the Contract for Manpower and 
Personnel Research and Studies II (COMPRS-II) for ARI under firm fixed-priced contracts by performing three 
inter-related tasks: (a) managing the COMPRS program in accordance with established operating procedures; (b) 
receiving and processing individual Statements of Tasks from ARI; and (c) managing, reporting progress on, and 
documenting completion of delivery orders. 
Key Deliverables: The following Delivery Orders were issued during Year 2: 
DO 0014 Automation of Army’s Basic Skills Program 
DO 0015 NCO Characteristics for the 21% Century: Assessment and Validation 
DO 0016 Year 2 Contract Administration 
DO 0017 Impact of ACES on Soldier Retention and Performance: A Research Plan 
DO 0018 Army Recruiting Market Segmentation Survey 
DO 0019 Support for Evaluation of Basic Research Proposals 
DO 0020 First Term Soldier Attrition and Management 
DO 0021 MOS Consolidation for the Future Battlefield 
DO 0022 Pilot Test of Spanish Language Entrance Screening Test: Phase I 
DO 0023 Update of ARI’s Officer Personnel Research Data Bases for 1999 and 2000 


Findings/Outcomes: 


Report Citations: 
Human Resources Research Organization. (1999). COMPRS-II Year 2 — Standard Operating Procedures (SOP). 


HumRRO contract report. 


Human Resources Research Organization (2000). Contract for Manpower and Personnel Research and Studies I 
(COMPRS-I]) Annual Report — Year Two (ARI Research Note 2001-01). Alexandria, VA: U.S. Army Research 
Institute for the Behavioral and Social Sciences. 
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DO-COR: Dr, Mark Young 
DO-ACOR: Dr. Trueman Tremble 
Project Director: Dr. Paul J. Sticha 


Program Area 
QR _X_ 


Background: The Army established the Army Continuing Education System (ACES) to promote lifelong learning 
opportunities for its members with the hope that these educational activities will support combat readiness and 
quality of life, and will enhance the competitive edge of the force. ACES includes several programs to meet the 
educational needs of soldiers and to help soldiers to apply the skills learned in the Army to obtain academic 
credentials needed for their later civilian life. These programs include (a) The American Council of Education 
Military Evaluations Program, (b) the Army Personnel Testing Program, (c) the Army Tuition Assistance Program, 
(d) the Functional Academic Skills Training Program, (e) the High Schoo] Completion Program, (f) the 
Servicemembers Opportunity Colleges Army Degree Program, and (g) the Army/American Council on Education 
Registry Transcript System. Soldier participation in ACES programs is coordinated by education counselors located 
at installation Army Education Centers. 

The Education Division of the U.S. Army Total Personne] Command (PERSCOM) requested that the U.S. Army 
Research Institute (ARI) initiate a preliminary study to examine the relationship between in-service civilian 
education under the ACES program, and soldier retention and performance. ARI has agreed to initiate such a study. 
PERSCOM’s Education Division, the sponsor of this effort, anticipates using the results of this research as a basis - 
for documenting the value of the ACES program for (a) attracting and retaining soldiers and (b) supporting the 
Army’s training, education, and leader development objectives. 
Project Objectives: The project objectives were as follows: 

1. Develop a detailed research plan for evaluating those aspects of the ACES program for which an is ad 
evaluation is most relevant, viable, and cost effective. 
2. Develop a plan for creating the database needed for conducting the data analyses for the program valuation 
Key Deliverables: Key project deliverables are: 
1. Review of previous research conducted in the military and civilian sectors since 1980. 
2. Written comprehensive evaluation research plan. 
3. Written database development plan. 
4. Final report. 
Findings/Outcomes: The research literature provides limited coverage of continuing education programs. Results 
indicate that those who participate in continuing education tend to be better qualified and more highly motivated 
soldiers (or employees) than those who do not. A positive effect of participation on performance is reflected in 
personal opinions, promotion rates, and actual performance ratings. Regarding retention, the research suggests that 
participation in continuing education increases the likelihood of reenlistment. The effect remains at a reduced 
magnitude when other factors are controlled statistically. The generality of the findings of past research is limited by 
the number of evaluation studies, the focus on a small number of continuing education programs, the inconsistent 
correction for selection bias, and the lack of an overall conceptual model to guide analyses. 

The evaluation plan addresses five ACES programs: (a) the Army Tuition Assistance (TA) Program, (b) the 
Servicemembers Opportunity Colleges Army Degree (SOCAD) Program (c) the Functional Academic Skills 
Training (FAST) program, (d) Military Occupational Specialty (MOS) Improvement Courses, and (e) Non- 
commissioned Officer (NCO) Leader Development Courses. The methodological approach addresses several 
potential evaluation problems, including non-random assignment, censored data, missing data, measurement error, 
and unobserved heterogeneity. The database development plan specifies variables from administrative databases and 
surveys that measure participation in ACES programs, assess retention and performance outcomes, and identify other 
characteristics that should be used as controls. The plan also identifies data-building procedures that will result in an 
analytically relevant evaluation database. 

Report Citations: Sticha, P.J., DiFazio, A.S., Dall, D.A., Handy, K, & Heggestad, E.D. (2000). Impact of the Army 
Continuing Education System (ACES) on soldier retention and performance: Final report (FR-WATSD-00-49). 
Alexandria, VA: Human Resources Research Organization. 
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DO# 0018 Title: Army Recruiting Market Segmentation Surve 


Program Area DO-COR: Dr. Morris Peterson 
DO-ACOR: 
AOS X_ Project Director: Mr. John Helmick (Westat) 


MT 
Status: Completed (February 25, 2000 — June 30, 2000 


Background: The Army needs redesigned marketing and recruiting campaigns. To inform and guide those 
campaigns, new research was needed on the broad set of factors that affect youth attitudes and willingness to enter 
the Army. Rand researchers developed surveys for youth and their parents designed to address these research needs. 
The surveys needed to be administered within a very short timeframe to provide data to the Army in a timely fashion. 
Project Objectives: The objectives of this delivery order were to administer computer-assisted telephone 
interviewing (CATI) surveys to a sample of 5,000 youth and 2,500 parents. A second sample of similar size was 
surveyed under a related delivery order. Westat designed the sampling plan and purchased the phone numbers for the 
survey samples for both delivery orders. 
Key Deliverables: Key deliverables included a project management plan, periodic raw data files, and a final letter 
report. 

Findings/Outcomes: The required data were collected in a timely fashion, providing the input necessary to support 
the Army’s marketing and recruiting efforts. 


Report Citations: n/a 


20 


DO# 0019 Title: Support for Evaluation of Basic Research Proposals ; 


Program Area DO-COR: Dr. Michael Drillings 
QR _ xX | DO-ACOR: 
AOS ____ Project Director: Dr. Deirdre Knapp, with Dr. George Lawton 


MT 
Status: Completed (March 20, 2000 — May 19, 2000 


Background: The Research and Advanced Concepts Office (RACO) of the U.S. Army Research Institute (ARI) has 
as a yearly requirement to evaluate basic research proposals. Evaluation requires careful reading and complete 
understanding of a wide variety of proposals; evaluating those proposals; and preparing a formal evaluation form for 
each one containing scores, detailed evaluations in various categories, and recommendations. Most of this work is 
done by in-house ARI scientists, however each proposal must be reviewed by multiple personnel with appropriate 
technical backgrounds. The reduction in ARI’s work force has resulted in a greatly increased workload. Therefore, 
RACO required external support to accomplish the year 2000 evaluations in the time allowed. 

Project Objectives: The objective was to evaluate basic research proposals falling predominantly in the areas of 
training, leadership, and personnel selection. 


Key Deliverables: Reviews of basic research proposals. 
Findings/Outcomes: n/a 
Report Citations: n/a 
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DO# 0020 Title: First-Term Soldier Attrition and Management 


Program Area DO-COR: Dr. Bruce Bell 
DO-ACOR: 
Project Director: Dr. Bill Strickland 


Status: Ongoing (May 26, 2000 — March 31, 2004 


Background: In 1996 the Office of the Assistant Secretary of the Army (Manpower and Reserve Affairs; ASA 
M&RA) asked the Army Research Institute (ARI) to draft a broad-based plan for carrying out a comprehensive, 
integrated examination of first-term enlisted attrition. ARI's plan provided a general outline for what has become 
a 5- to 6-year program for investigating attrition across the first-term of the enlisted life cycle. ARI seeks to 
produce a comprehensive understanding of the causes of attrition over the course of the first term of enlistment. 
The plan calls for a longitudinal examination of the personal (e.g., expectations, background), organizational 
(e.g., culture and climate), and extra-organizational (e.g., attitudes of significant others, opportunities for civilian 
employment) variables that potentially combine to influence an individual's "fit" with and success in an 
organization, in this case, the U.S. Army. Work under earlier delivery orders (COMPRS #79 and COMPRS II 
#06 and #09) refined the plan and began data collection on the FY1999 Active Army accession cohort while its 
members were in the Training Base. This delivery order continues those data collection and analysis tasks into 
the first unit of assignment for these soldiers. 
Project Objectives: The objective of this delivery order is to continue progress on the longitudinal study of attrition 
during the first term of service for FY 1999 accessions. 
Key Deliverables: Key project deliverables consist of: 
Surveys for use in FY2000 and FY2001 to track the FY 1999 cohort. 

An Exit Survey for use with FY1999 cohort soldiers who leave the Army before the end of their first term. 
Two briefings per year for ARI’s Attrition Advisory Panel. 

Two briefings per year for ARI’s sponsors. 

Two technical reports documenting ess and results over the course of FY2000 and FY2001. 
Findings/Outcomes: 
Report Citations: 
Sipes, D.E., & Strickland, W.J. (2002). Factors influencing the continuance intentions of IET graduates (IR-02-22). 
Alexandria, VA: Human Resources Research Organization. 


Sipes, D.E., Strickland, W.J., & Sun, S. (2002). Attrition and career intentions among the Army’s FY99 entry cohort 
DTR-02-14). Alexandria, VA: Human Resources Research Organization. 
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DO# 0021 Title: MOS Consolidation for the Future Battlefield 


Program Area DO-COR: Dr. Elizabeth Brady 
QR xX. DO-ACOR: 
Project Director: Mr. Allan Akman 


Status: Completed (June 13, 2000 — May 8, 2001 


Background: The Army has been routinely faced with changing tasks, jobs, and occupational structure in response 
to changes in doctrine, leadership, training, and mission. Currently, the Army is faced with yet another attempt to 
restructure its jobs to meet the challenges of the future battlefield in the 21" Century. With advances in technology, 
changes in the number and range missions, and future world challenges, the Army, too, must change their approach 
in training soldiers who are of capable of meeting these challenges. A study of the enlisted occupational structure by 
the ADS XXI Task Force concluded that Military Occupational Specialty (MOS) requirements tend to be too 
narrow. Consequently it is expected that soldiers of the future will need to be multi-skilled, and their jobs be 
redefined to encompass these changes. 
Project Objectives: The primary objective of this effort was to assess and document the feasibility of a potential 
MOS consolidation by using a front-end analysis (FEA) procedure on Army military occupational specialties (MOS) 
that represent the future battlefield. The FEA addressed the expected training and personnel (e.g., course length, 
transition training, ASVAB, physical demands, recruitment) for the MOS under study. The FEA used the Task 
Knowledges Commonality Analysis Method (TKCAM). 

A secondary objective was to lay the foundation for future MOS consolidations based on this primary objective. 
To fully meet the challenges of the future Army, time and resources will be needed to assess all jobs within the 
Army. If the U.S. Army expects to be at the forefront of the future battlefield, changes to occupational structure need 
to be planned for now so they can be implemented in time to guarantee ultimate success in the future. 
Key Deliverables: Final report (Brigade Combat Team 8 MOS TKCAM Summary Final Report) and briefing. 


Findings/Outcomes: 


Report Citations: 
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Title: Pilot Test of Spanish Language Entrance Screening Test: Phase I 
Program Area DO-COR: Dr. Naomi Verdugo 
QR X_ DO-ACOR: 
Project Director: Dr. Deirdre Knapp 


Status: Completed (July 25, 2000 — May 4, 2001) 


Background: Considering the rapid growth of the Hispanic population and the Census Bureau’s projections for 
continued growth in the decades to come, a Spanish language entrance screening test can potentially expand the 
Army’s recruiting market. Such a test would allow the Army to access highly able Spanish speakers and then provide 
English language training to them before they join their unit. The Army plans to offer the Spanish entrance screening 
test in at least nine recruiting battalions with heavily Hispanic populations. The basic plan is to enlist applicants on a 
provisional basis based on their performance on a Spanish language screening test and the AFQT. After accession 
they will be sent for ESL training and retake the ASVAB. If they fail to pass the ECLT with a score of 70 or better or 
do not score in Category I-IIIB on the AFQT, they will be discharged from duty. 

The effort to prepare for the implementation of the Spanish language entrance test pilot program and its subsequent 
evaluation will be divided into two phases. The first phase is the subject of the present delivery order. Its purpose is 
to evaluate existing commercial off-the-shelf Spanish language tests for similarity to the AFQT and to develop an 
implementation plan and evaluation plan. At least 1 year into the implementation of the pilot test, the contractor will 
begin the second phase — an evaluation of the pilot test. 

Project Objectives: The goals of this delivery order are to support efforts to field a commercial off-the-shelf or 
other existing test to screen Spanish-speaking enlistment prospects for trainability. This test will be administered in 
Spanish. In addition to the contractor reviewing existing tests and comparing distributions of scores on the selected 
test as compared to the AFQT, the contractor will develop a detailed implementation plan and a detailed evaluation 
plan for the 24-month pilot test of this option. 


Key Deliverables: The key deliverables are a pilot test recommendations report and detailed pilot implementation 
plans. 


Findings/Outcomes: Two Spanish language tests — the Spanish Wonderlic and the Prueba de Aptitud Academica 
(PAA) will be evaluated in the pilot “Foreign Language Recruiting Initiative” project. Starting in October 2001, 
USMEPCOM will administer the Spanish Wonderlic to qualified applicants. PAA scores for those who have taken 
this examination in high school (an estimated 90% of the Puerto Rican applicants) will be obtained from the College 
Board. In addition to the pilot test, portions of the program will be evaluated using archival data and new data 
collected prior to the pilot effort. Specifically, Spanish Wonderlic data have been collected by the ESL schools in 
San Antonio and Puerto Rico. We also collected English Wonderlic calibration data from a sample of new recruits in 
the fall of 2001 (see COMPRS DO #35). 

Report Citations: 

Medsker, G.J., Ramos, R.A., Knapp, D.J., McCloy, R.A. & Handy, K. (2001). U.S. Army Foreign Language 
Recruiting Initiative (FLRI): Pilot Test Recommendations Report. Alexandria, VA: Human Resources Research 


Organization. 
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Title: Update of ARI’s Officer Personnel Research Data Bases 
Program Area | DO-COR: Dr. Peter Greenston 
QR X_ DO-ACOR: 
AOS Project Director: Dr. Deirdre Knapp/Ms. Winnie Young 


MT 
Status: On 


Background: Since the 1970s, the U.S. Army Research Institute (ARI) has maintained a set of databases that 
contain historical and current data on the U.S. Army officer personnel. These databases have provided a valuable 
resource for research and analyses in the area of policy, manpower, and personnel issues that are important to the 
U.S. Army. Because of the significance of these databases and the need to keep information current, regular updates 
must be performed. Currently, the databases are being updated every other year and the last update of 1997/98 cycle 
was completed in September 1999. The purpose of this project is to provide for the next cycle of 1999/2000 update 
as required by the Selection and Assignment Research Unit (SARU) of ARI. 
Project Objectives: The objectives of this effort are to provide updates for three main data bases in the Officer 
Personnel Research Data Bases: the Officer Administrative Data Base (OADB), the Officer Longitudinal Research 
Data Base (OLRDB), and the Officer Standardized Educational Testing Data Base (OSETDB). 
Findings/Outcomes: In addition to updating the databases, the inadvertent deletion of valid cases in previous 
updates was corrected. Also, programs for performing the updates were converted from PL1 language to SAS-PC, 
which will make future updates quicker and easier to perform. 
Report Citations: 
Young, W.Y. (2002). Update of U.S. Army Research Institute’s Officer Personnel Data Bases for 1999 and 2000 
FR-02-19). Alexandria, VA: Human Resources Research Organization. 
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DO# 0024 Title: Evaluation of the Buddy Team Assignment Program 


Program Area DO-COR: Dr. Peter Legree 
QR X DO-ACOR: 
a Project Director: Dr. Peter Ramsberger 


Status: Completed (September 29, 2000-July 29, 2002 


Background: The Buddy Team Assignment Program (BTAP) was initiated to reduce attrition among initial term 
soldiers at their first duty station following One Station Unit Training (OSUT). The program involves assigning two 
soldiers who have been designated as battle buddies in OSUT to the same company at their first duty station. The 
hope is that this will smooth the transition to the operational environment, increase overall satisfaction, and thereby 
reduce attrition. 
Project Objectives: The objectives of this effort were to collect data to address: (a)-whether the BTAP is being 
implemented as originally planned, (b) what impact having a buddy has on soldiers as they make the transition from 
training to their operational units (e.g., reduced levels of stress, increased confidence), and (c) whether such effects 
ield the desired result of reduced attrition. 

Key Deliverables: Deliverables included a database incorporating survey data as well as relevant administrative 
records, and a final report that details the methodology and findings as well as providing recommendations for 
program continuance/improvement. 
Findings/Outcomes: Findings from the end-of-training survey strongly support the OSUT battle buddy program. For 
instance, over half of the soldiers said their battle buddy had a positive or very positive impact on them in regard to 
14 dimensions listed in the survey (e.g., confidence, ability to meet performance standards). The field survey results 
suggested that there were administrative problems at the programs outset, with a sizeable number of soldiers who 
were designated to be in the program (40%) indicating that they had not been assigned to their first duty station with 
their OSUT battle buddy. Although the outcomes for those who were assigned together were less positive than in 
OSUT, an average of 35% of BTAP soldiers did say their buddy had a positive effect on them across the dimensions 
rated. Social Security Numbers from the end-of-training and field surveys were matched to the Enlisted Master File 
so that analysis of the impact on attrition could be carried out. When soldiers in training who said they were to be 
assigned with their battle buddies were compared with those who were not, no significant difference in subsequent 
attrition was found. There were too few cases of attrition amongst the field survey respondents to carry out this 
analysis. Key recommendations were based on the findings that (a) the unit level at which buddies were assigned 
(e.g., squad, platoon) was strongly related to the level of interaction, and thus the amount of influence, and (b) 
whether one liked ones battle buddy was related to a variety of other factors (rating of battle buddy, rating of battle 
buddy influence). Therefore it is recommended that every effort be made to ensure BTAP participants are assigned at 
the lowest unit level possible, and that already-initiated efforts to match battle buddies in OSUT in such a way as to 
maximize the potential for them to get along be continued and implemented. 
Report Citations: 
Ramsberger, P. F., Legree, P., Mills, L. (2002). Evaluation of the Buddy Team Assignment Program (DFR 02-20). 
Alexandria, VA: The Human Resources Research Organization. 
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DO# 0025 Title: Addressing Operational Issues in Support of the Institutionalization of the Assessment 
of Individual Motivation (AIM 


Program Area DO-COR: Dr. Mark Young 
QR xX DO-ACOR: 
AOS ae Project Director: Dr. Deirdre Knapp 


MT 


Status: Ongoing (September 30, 2000-September 6, 2002 


Background: In 1996, the U.S. Army Research Institute for the Behavioral and Social Sciences (ARI) developed a 
new faking-resistant measure of motivational attributes designed to predict enlisted attrition and duty performance. 
This measure is called the Assessment of Individual Motivation (AIM). ARI carried out an AIM Pre-Implementation 
Research Program (1998-1999) to assess whether AIM would be viable for screening enlisted Army applicants. This 
program (a) validated AIM against initial entry training attrition, (b) evaluated AIM’s potential adverse impact when 
used for enlistment screening, and (c) assessed AIM’s resistance to faking. As of February 2000, the Army has 
implemented AIM as a new market-expansion screening tool under the “GED Plus” program. A contract effort is 
now required to address several operational issues pertaining to AIM’s ongoing use and viability for other market 
segments. 

Past evaluations of AIM have been conducted exclusively in a research context. Under this proposed effort, it will 
be particularly important to assess how well AIM’s validity holds up in an actual operational (as opposed to a 
research) context. This assessment will be done using AIM data collected under the GED Plus program. In order to 
address this, and other relevant operational and policy issues, it will be necessary to develop and update databases 
for use in AIM’s refinement and evaluation. 

Project Objectives: The objective of the proposed contract effort is to refine AIM and support its continued 
operational use under the GED Plus program. Specifically, this effort will (a) update databases (research and 
operational) needed for AIM’s assessment and refinement, (b) determine AIM’s validity as an attrition predictor 
using operational data, (c) evaluate and equate new alternate AIM forms developed under a previous contract, (d) 
examine the effects of recruit characteristics on first-term attrition, and (e) manage the coordination and integration 
of multiple AIM evaluation/refinement efforts being conducted both under this contract and by independent 
consultants working directly for ARI. 

Key Deliverables: Deliverables include data analysis plans, databases, briefing materials, and two technical reports. 
One report will include all the relevant project details. The second report will be purged of sensitive information 
regarding the operational AIM. The first report will not be for public release, but the second one will. 
Findings/Outcomes: Two in-progress review meetings were conducted to review analysis plans and analysis results. 
The restricted distribution technical report is final, and is serving as the basis for a second report for public release 
that excludes sensitive information (e.g., about AIM scoring protocols). An expert review panel was convened to 
review the AIM findings. 

Report Citations: 

Knapp, D.J., Waters, B.K, & Heggestad, E.D. (Eds.) (2002). Investigations Related to the Implementation of the 
Assessment of Individual Motivation (AIM) (HumRRO Contract Report). Alexandria, VA: Human Resources 
Research Organization. 
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DO-COR: Dr. Ron Tiggle 
DO-ACOR: 
Project Director: Dr. Deirdre Knapp 


Status: Ongoing (October 10, 1999-October 16, 2001 


Background: Providing information on manpower and personnel issues to Army decision-and policy-makers is often 
a complex, dynamic, multi-stage, iterative process. The accuracy and timeliness of information provided to decision 
makers are of paramount importance in the quality of decisions and policies. Over the next decade, the U.S. Army 
will experience an increasing requirement to bring individuals into the Army who are trainable in a wide variety of 
skill areas. To meet and maintain its high quality manpower needs of the new millennium, the Army will have to 
develop and implement programs that allow it to locate, assess, assign, and use human resources more efficiently and 
effectively than it ever has before. As new Army policies are being developed to enhance the Army's ability to man 
the force, the Army needs programs of research and studies that will provide a quick response mechanism to gather 
and analyze data on the expected or actual short-term effectiveness of those policies. 

Scientific and technical support services are being used that lead to the development and implementation of 
programs of research and studies on the expected or actual effectiveness of Manpower, Personnel, and Training 
(MPT) programs. These efforts are part of ARI's MPT program to man the force by conducting research and studies 
to improve the Army's ability to recruit, identify, assess, classify, assign, lead, train, and maintain the personnel 
required for the Army. 
Project Objectives: The objectives of this delivery order are to administer the Contract for Manpower and 
Personnel Research and Studies II (COMPRS-II) for ARI under firm fixed-priced contracts by managing three inter- 
related tasks: (a) managing the COMPRS program in accordance with established operating procedures; (b) 
receiving and processing individual Statements of Tasks from ARI; and (c) managing, reporting progress on, and 
documenting completion of delivery orders. 
Key Deliverables: The following Delivery Orders were issued during Year 3: 
DO 0024 Evaluation of the Buddy-Team Assignment Program 
DO 0025 Addressing Operational Issues in Support of the Institutionalization of AIM 
DO 0027 Improving Selective Reenlistment Bonus (SRB) Allocation Procedures in the Army 
DO 0028: TCKAM User’s Manual Update 
DO 0029: A Social Sciences Analysis of the Balkan Conflict 
DO 0030: Adoption of New Army Aptitude Area Composites 
DO 0031: Impact of the Army Continuing Education System (ACES) on Soldier Retention and Performance: 
Database Development 
DO 0032: Special Report on Distance Learning 
DO 0033: Impact of the Army Continuing Education System (ACES) on Soldier Retention and Performance: 
Database Analyses 
DO 0034: Personnel and Training Decisions Which Could be Supported with Research, Analysis, or Data: A Case 
Study of MOS Minimum Enlistment Standards 
Findings/Outcomes: 
Report Citations: 
Human Resources Research Organization. (2000). COMPRS-II Year 3 — Standard Operating Procedures (SOP). 
Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. 


Program Area 
QR ___ 


Human Resources Research Organization. (2000). Contract for Manpower and Personnel Research and Studies II 
(COMPRS-II) Annual Report — Year Three. (ARI Research Note 2002-05). Alexandria, VA: U.S. Army Research 
Institute for the Behavioral and Social Sciences. 
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DO# 0027 Title: Improving Selective Reenlistment Bonus (SRB) Allocation Procedures in the Arm 


Program Area DO-COR: Dr. Peter Greenston 
QR xX DO-ACOR: 
Project Director: Dr. Pat Mackin (SAG Corporation), with the Lewin Group 


Status: Completed (November 22, 2000-May 31, 2002 


Background: What are the factors that influence a soldier’s decision to reenlist for another term or to leave the 
Army? Army managers must have good information about the effects of pays such as the Selective Reenlistment 
Bonus (SRB) in order to manage the enlisted force. 

Existing empirical estimates fail to take into account the most recently available data for the post-drawdown 
period. Moreover, the models currently used for SRB management are not based on a structural economic model of 
occupational choice. When non-structural models become obsolete (i.e., cease to fit the data well), it is difficult to 
ascertain the source of errors. Structural models, on the other hand, should provide a more robust predictor of 
reenlistment behavior. Finally, the effects of new features to the SRB program, such as a location-specific bonus 
differential, have never been estimated. 
Project Objectives: The objective of this study was to develop empirical models that quantify the impact of 
monetary incentives on reenlistment behavior. The models are at a sufficient level of detail to allow them to be 
applied to manage the Army’s SRB program. Additionally, the i sae ear the results of the empirical 
analysis in a Sump: PC- based anal ical tool for use by SRB 


9, and final report. 

Findings/Outcomes: A rational choice ScononeHe model based on logistic regression was developed. This was 
used a basis for estimating the effects of the SRB for different occupations and reenlistment points (e.g., first, 

second). The model was also used as a basis for an automated tool that estimates SRB effects given various changes 

g., pay raises, inflation rates). 


Report Citations: 
Hogan, P.F., Espinosa, J., Mackin, P.C., & Greenston, P.M. (2002). A Model of Army Reenlistment Behavior: 
Estimates of the Effects of Army’s Selective Reenlistment Bonus on Retention by Occupation (FR-02-34). 

Alexandria, VA: Human Resources Research Organization. 
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DO# 0028 Title: Task Knowledge Commonality Analysis Method (TKCAM) User’s Manual Update 


Program Area DO-COR: Mr. Bill Badey 

QR X_ DO-ACOR: 

Project Director: Dr. Deirdre J. Knapp (with Mr. Allan Akman, Akman Associates) 
MT 

Status: Completed (January 29, 2001 — March 28, 2001 


Background: HQ TRADOC command elements and schools are preparing to conduct numerous enlisted Military 
Occupational Specialty mergers in order to comply with Army Development System (ADS) XXI initiatives which 
will soon be approved by the US Army Chief of Staff. With this, Army Regulation (AR) 611-1 requires 
documentation of occupational restructures as well as updates to job descriptions contained in various Army 
Regulations and Pamphlets. TKCAM, through countless tests and practical applications is recognized as a tool that 
facilitates development of AR 611-1 analysis requirements and imparts a macro view of likely MOS retraining 
requirements, thus allowing training developers to realign training necessary to sustain successful job performance of 
the merged MOS. The current TKCAM User's Manual alludes to but does not precisely reference the use of TR 350- 
70 training analysis products (i.e., task knowledge's, a derivative of a task training development and/or evaluation 
process). Consequently in order for TKCAM User's to properly attain and apply task knowledge(s) as part of a 
TKCAM application an examination and accurate reference in TKCAM to TR 350-70 must be completed. 
Project Objectives: The objective of this effort was to update the TKCAM User’s Manual to include information as 
it relates to the use of task analysis results. 


Key Deliverables: The key deliverable was an updated User’s Manual | 
Findings/Outcomes: n/a 
Report Citations: n/a 
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DO# 0029 Title: A Social Sciences Analysis of the Balkan Conflict 


Program Area DO-COR: Dr. Ruth Phelps 
QR _X_ DO-ACOR: 
AOS ___ Project Director: Dr. Monte Smith (L3 Communications) 


MT 
We tt a ls ee = DO SUMMONS ee a te 
Background: The U.S. Army has been deployed to the Balkans since 1992 in both NATO and UN operations and 
the fragile current peace seems dependent on the continued presence of outside forces. Soldiers assigned to the 
region, however, have reported difficulty in understanding the local population and question how their presence will 
contribute to a lasting peace. In order to assist the Army in understanding the political, socio-cultural and historical 
complexity of the region, the U.S. Army Research Institute produced an extensive report covering a wide range of 
topics including the geography of the region, ethnic groups, languages, and a summary of military operations since 
1992. This document is entitled “An Old Mosaic in New Mortar: Tracings of the Balkan Cultural and Historical 
Landscape.” 
Project Objectives: The objective of this project was to develop an interactive compact disk (CD) that can be used 
to prepare Army personnel for deployment to the Balkans and serve as a reference tool for social science analysts. 
This product was based on the above-referenced document entitled: “An Old Mosaic in New Mortar: Tracing the 
Balkan Cultural and Historical Landscape.” 


Key Deliverables: The primary deliverable was an interactive CD. 
Findings/Outcomes: n/a 
Report Citations: n/a 
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DO# 0030 Title: Adoption of New Army Aptitude Area (AA) Composites 


Program Area DO-COR: Dr. Peter Greenston 
QR _X_ DO-ACOR: 
Project Director: Dr. Mary Ann Lightfoot 


Status: Ongoing (February 15, 2001-December 31, 2002 


Background: ARI and George Washington University researchers have proposed a two-tiered classification system. 
The proposed system would consist of a set of 17 second-tier Aptitude Area (AA) composites, which would replace 
the nine composites the Army has used for many years, and 150 first-tier composites for use with assignment 
software designed to improve the match of entering recruits to MOS in terms of a performance index. Before 
considering implementation of the two-tiered system, ARI requires that it be evaluated, along with a set of interim 
composites based on the existing job families. The interim composites were developed using the same principles as 
the proposed composites. They were implemented in Jan 02 when the composition of the ASVAB was changed by 
eliminating two tests (NO and CS). 
Project Objectives: The original purpose of the project was to complete development work on proposed new AA 
composites making up a two-tiered classification system. The focus was changed to evaluating the composites and 
job families of the two-tiered system as a result of intervening events that occurred during the early months of the 
project. The first part of the evaluation, which was completed, involved review of the proposed revisions to the 
Army’s classification system by an expert panel. The second part consists of a series of empirical analyses of the 
composites and job families. 
Key Deliverables: The primary deliverable will be a written final report of the empirical evaluation. 
Report Citations: 
Alley, W. E., Schmitt, N., Sorenson, R. C., & Wise, L. L. (2001). Army Classification Review. Unpublished report 
submitted to the U. S. Army Research Institute for the Behavioral and Social Sciences. 
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DO# 0031 Title: Impact of the Army Continuing Education System (ACES) on Soldier Retention and 
Performance: Database Development 


Program Area DO-COR: Dr. Mark Young 

QR _X_ DO-ACOR: Dr. Trueman Tremble 
AOS Project Director: Dr. Paul J. Sticha 
MT 
Status: On 


(April 13, 2001 — September 30, 2002 


Background: In 1998, the U.S. Total Army Personnel Command (PERSCOM) Education Division requested that 
the U.S. Army Research Institute (ARI) initiate a preliminary study to begin examining the relationship between in- 
service civilian education under the Army Continuing Education System (ACES) and soldier retention and 
performance. PERSCOM’s Education Division, the sponsor of this effort, anticipates that the results of this research 
will provide data to document the value of the ACES program for (a) attracting and retaining soldiers and (b) 
supporting the Army’s training, education, and leader development objectives. In support of these objectives, ARI 
initiated an FY 2000 contract effort titled “Impact of the Army Continuing Education System (ACES) on Soldier 
Retention and Performance: A Research Plan.” The goal of this effort was to develop a technically sound research 
plan for a future evaluation of ACES. The approach developed in this research plan relies upon the use of ACES 
participation data obtained from the Education Management Information System (EDMIS). 

The anticipated assessment will evaluate the impact of ACES programs using two different databases to be 
developed under this effort. The exploratory analyses of these data for the evaluation of ACES programs is to be 
conducted under a follow-up delivery order (DO 33). Data from a limited sample of EDMIS sites will be used to 
evaluate the effects of selected ACES programs on attrition, early reclassification, and reenlistment. Criterion and 
control variables for these analyses will be obtained from automated personnel records. In addition, data being 
collected for another research effort, the NCO21 project (see DO 15), will be used as a vehicle for examining the 
effects of selected ACES programs on soldier performance and promotion. ACES-related questionnaire items have 
recently been developed by ARI, with assistance from PERSCOM, for use in the NCO21 project. 

The administrative database will allow the future examination of relationships between participation in selected 
ACES programs and attrition, early reclassification, and reenlistment among soldiers who were assigned to 
installations where EDMIS was operational as of 1996. In addition, the NCO21 database will be used to examine 
relationships between individual participation in ACES-sponsored continuing education programs and soldiers’ 
subsequent performance and promotion. This database will support analyses involving MOS Improvement Courses, 
NCO Leadership Development Courses, and programs provided to assist soldiers in obtaining an advanced degree or 
credential (i.e., Tuition Assistance, SOCAD). 

Project Objective: The project objective is to develop the databases required to conduct the preliminary ACES 
evaluation to be executed under a later contract effort. 
Key Deliverables: Key project deliverables are: 
1. Administrative database and documentation. 

2. Updated NCO21 database and documentation 
Final report. 
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DO# 0032 Title: Special Report on Distance Learning 


Program Area DO-COR: Dr. Robert Wisher 

QR _X_ DO-ACOR: 

AOS ___ Project Director: Dr. Peter Ramsberger 
MT 

Status: Completed (April 25, 2001 — April 30, 2002 


Background: The U.S. Army is transforming many of its courses from a resident mode of instruction to a distance 
learning mode. How well this works in a military training setting has been debated by researchers. The U.S. Army 
Research Institute has been actively engaged in research on the topic, and has numerous technical reports on the 
merits and shortcomings of this technology. Several of these publications have been written to an audience of 
training developers, instructional designers, and training researchers rather than to an audience that needs only a 
general grasp of the underlying theories of learning and the technical details of development and delivery. 
Project Objectives: The objectives of this effort were to recompose a body of research documentation into a plain 
language report replete with photographs and figures that conveys the essential findings and future opportunities for 
distance learning in the Army. 


Key Deliverables: Deliverables included an outline of the report, a draft, a subsequent draft that included visuals, 
and the final report. 


Findings/Outcomes 


Report Citations: 
Wisher, R.A., Sabol, M.A., Moses, F.L., & Ramsberger, P.A. (2002). Distance Learning: The Soldier’s Perspective 
(ARI Special Report 49). Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. 
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Program Area DO-COR: Dr. Mark Young 
QR X_ DO-ACOR: Dr. Trueman Tremble 
Project Director: Dr. Paul J. Sticha 


Status: Pending (September 4, 2001 — December 31, 2002 


Background: In 1998, the U.S. Total Army Personnel Command (PERSCOM) Education Division requested that 
the U.S. Army Research Institute (ARI) initiate a preliminary study to begin examining the relationship between in- 
service civilian education under the Army Continuing Education System (ACES) and soldier retention and 
performance. PERSCOM’s Education Division, the sponsor of this effort, anticipates that the results of this research 
will provide data to document the value of the ACES program for (a) attracting and retaining soldiers and (b) 
supporting the Army’s training, education, and leader development objectives. In support of these objectives, ARI 
initiated an FY 2000 contract effort titled “Impact of the Army Continuing Education System (ACES) on Soldier 
Retention and Performance: A Research Plan.” The goal of this effort was to develop a technically sound research 
plan for a future evaluation of ACES. The approach developed in this research plan relies upon the use of ACES 
participation data obtained from the Education Management Information System (EDMIS). 

The assessmient effort included here is intended to provide a limited, exploratory evaluation of the impact of 
ACES programs using two different databases. These databases will have been developed or updated under a 
separate contract. Data from a limited sample of EDMIS sites will be used to evaluate the effects of selected ACES 
programs on attrition, early reclassification, and reenlistment. Criterion and control variables for these analyses will 
be obtained from automated personnel records. In addition, data being collected for another research effort (see DO 
15) will be used as a vehicle for examining the effects of selected ACES programs on soldier performance and 
promotion. ACES-related questionnaire items have recently been developed by ARI, with assistance from 
PERSCOM, for use in the NCO21 project. 

Project Objectives: The project objective is to conduct exploratory data analyses for evaluating the effects of 
participation in selected ACES programs on soldier retention and performance. 
project deliverable is a final report describing evaluation results. 


Findings/Outcomes: 
Report Citations: 


35 


Title: Personnel and Training Decisions Which Could be Supported with Research, 
Analysis, or Data: A Case Study of MOS Minimum Enlistment Standards 
DO-COR: Dr. Peter Greenston 
DO-ACOR: 

Project Director: Dr. Mary Ann Lightfoot 


DO# 0034 


Program Area 
QR _X 
AOS __ 


MT 
Status: Ongoing (June 20, 2001-January 25, 2003 


Background: Army personnel managers frequently need to make tradeoffs between soldier numbers, quality, and 
training, and other factors when making personnel management and training decisions. Often, data pertaining to such 
tradeoffs exist but are not integrated into the decision process because they are not readily accessible. There is a need 
to establish better methods for accessing and integrating research and study findings into personnel management and 
training decisions. One issue is how soldier quality is to be distributed across MOS and the implications of changing 
MOS minimum enlistment standards. 
Project Objectives: The objective of this study is to investigate the trade-offs between lowering minimum enlistment 
training standards and training completion, and to develop methods that ARI researchers can use to assess the 
appropriateness of cut scores. 
Key Deliverables: The primary deliverable will be a written methodology report with results on at least 3 MOS. 


Findings/Outcomes: 
Report Citations: 
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Test: Phase I 


Title: Pilot Test of Spanish Lan e Entrance Screening 
DO-COR: Dr. Naomi Verdugo 
DO-ACOR: 


Project Director: Dr. Deirdre Knapp 


Status: Ongoing (September 4, 2001 — December 31, 2003 


Background: Considering the rapid growth of the Hispanic population and the Census Bureau’s projections for 
continued growth in the decades to come, a Spanish language entrance screening test can potentially expand the 
Army’s recruiting market. Such a test would allow the Army to access highly able Spanish speakers and then provide 
English language training to them before they join their unit. The Army plans to offer the Spanish entrance screening 
test in at least nine recruiting battalions with heavily Hispanic populations. The basic plan is to enlist applicants on a 
provisional basis based on their performance on a Spanish language screening test and the AFQT. After accession 
they will be sent for ESL training and retake the ASVAB. If they fail to pass the ECLT with a score of 70 or better or 
do not score in Category I-IHB on the AFQT, they will be discharged from duty. 

The effort to prepare for the implementation of the Spanish language entrance test pilot program and its subsequent 
evaluation have been divided into two phases. The first phase was conducted under Delivery Order #22. Its purpose 
was to evaluate existing commercial off-the-shelf Spanish language tests for similarity to the AFQT and to develop 
an implementation plan and evaluation plan. Phase II, the subject of the present delivery order, is to support 
implementation of the pilot test and conduct an evaluation of the pilot test. 
Project Objectives: The goals of this delivery order are to support efforts to field a commercial off-the-shelf or 
other existing test to screen Spanish-speaking enlistment prospects for trainability. This test will be administered in 
Spanish. HumRRO will support the pilot test, and develop and analyze an evaluation database. 
Key Deliverables: The key deliverables are preliminary and final pilot test evaluation reports and briefings. 
Findings/Outcomes: Two Spanish language tests — the Spanish Wonderlic and the Prueba de Aptitud Academica 
(PAA) will be evaluated in the pilot “Foreign Language Recruiting Initiative” project. Starting in January 2002, 
USMEPCOM began administering the Spanish Wonderlic to qualified applicants. PAA scores for those who have 
taken this examination in high school (an estimated 90% of the Puerto Rican applicants) will be obtained from the 
College Board. 


Report Citations: 


DO# 0035 


Program Area 
QR _X_ 
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DO# 0036 Title: Occupational Analysis of Survey Results for Officer Branch 42 and Enlisted MOS 
19D and 54B 


Program Area DO-COR: Mr. Bill Badey 
QR X_ DO-ACOR: 
os Project Director: Dr. Bill Strickland, with Akman Associates 


Sta Completed (September 30, 2001 — March 30, 2002 


Background: Under a previous prime contract with ARI, the Institute for Job and Occupational Analysis (JOA) 
collected field data to support occupational analyses of several Army officer Branches and enlisted Military 
Occupational Specialties (MOS). HumRRO and Akman Associates were subcontractors to IJOA for this work. 
Because JJOA is no longer a viable organization, ARI needs support from HumRRO and Akman Associates to 
complete several of these analyses. 
Project Objectives: Under this delivery order, we will complete the analyses for Officer Branch 42 (Adjutant 


Findings/Outcomes: Reports and briefing materials for MOS 19D, 54B, and Branch 42 were denveed to ARI and 
the Proponent schools. (The schools waived in-person briefings. 


Report Citations: n/a 
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DO# 0037 Title: Year 4 Contract Administration 


Program Area DO-COR: Dr. Michelle Zazanis 
QR DO-ACOR: 
Project Director: Dr. Deirdre Knapp 


Status: Ongoing (October 17, 2001 - October 16, 2002 


Background: Providing information on manpower and personnel issues to Army decision-and policy-makers is often 
a complex, dynamic, multi-stage, iterative process. The accuracy and timeliness of information provided to decision 
makers are of paramount importance in the quality of decisions and policies. Over the next decade, the U.S. Army 
will experience an increasing requirement to bring individuals into the Army who are trainable in a wide variety of 
skill areas. To meet and maintain its high quality manpower needs of the new millennium, the Army will have to 
develop and implement programs that allow it to locate, assess, assign, and use human resources more efficiently and 
effectively than it ever has before. As new Army policies are being developed to enhance the Army's ability to man 
the force, the Army needs programs of research and studies that will provide a quick response mechanism to gather 
and analyze data on the expected or actual short-term effectiveness of those policies. 

Scientific and technical support services are being used that lead to the development and implementation of 
programs of research and studies on the expected or actual effectiveness of Manpower, Personnel, and Training 
(MPT) programs. These efforts are part of ARI's MPT program to man the force by conducting research and studies 
to improve the Army's ability to recruit, identify, assess, classify, assign, lead, train, and maintain the personnel 
required for the Army. 
Project Objectives: The objectives of this delivery order are to administer the Contract for Manpower and 
Personnel Research and Studies I] (COMPRS-II) for ARI under firm fixed-priced contracts by managing three inter- 
related tasks: (a) managing the COMPRS program in accordance with established operating procedures; (b) 
receiving and processing individual Statements of Tasks from ARI; and (c) managing, reporting progress on, and 
documenting completion of delivery orders. 
Key Deliverables: The following Delivery Orders have been issued during Year 4: 
DO 0035 Pilot Test of a Spanish Language Entrance Screening Test 
DO 0036 Occupational Analysis of Survey Results 
DO 0038 Enhancing OCS Enrollment in the Army National Guard 
DO 0039: Analysis of Why FORSCOM and TRADOC Soldiers are Absent Without Leave 
DO 0040: New Predictors for Selecting and Assigning Objective Force Soldiers 
DO 0041: Reducing Advanced Individual Training (AIT) to Less than 26 Weeks 
Findings/Outcomes: 
Report Citations: 
Human Resources Research Organization. (2001). COMPRS-II Year 4 — Standard Operating Procedures (SOP). 
Alexandria, VA: U.S. Army Research Institute for the Behavioral and Social Sciences. 
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DO# 0038 Title: Enhancing OCS Enrollment in the Army National Guard (ARNG 


Program Area DO-COR: Dr. Joseph Hagman 

QR XxX DO-ACOR: 

AOS __ Project Director: Mr. Billy White (L3 Communications) 
MT 

Status: Ongoing (December 26, 2001 — August 21, 2002) 


Background: Army National Guard soldiers can be commissioned in any of four ways: (a) by completing the 
Reserve Officers Training Corps (ROTC) program, (b) by completing Officer Candidate School (OCS), (c) through 
direct commissioning, or (d) by transferring from the Active Component (AC) (e.g., Dillon, 1999; U.S. Army 
Training Board, 1988). Historically, each method has contributed its annual fair share of ARNG commissioned 
officers (i.e., 320, 950 [state OCS], 270, and 840, respectively [Army Training Requirements and Resources System 
(ATRRS)} to the number of ARNG soldiers with the rank of 2LT or above). Yet, with the annual attrition rate of 
2,300 company-grade officers (i.e., 2LT, 1LT, and CPT) and the promotion of about 600 CPTs to the rank of MAJ 
each year, as of ] July 2001 (Standard Installation/Division Personnel System [SIDPERSJ), the ARNG had over 
5,900 fewer company-grade officers than it needs. Senior ARNG Readiness Center staff members, charged with 
oversight of officer training programs, have attributed the cause of this shortfall primarily to a reduced OCS 
attendance rate among ARNG enlisted soldiers (Gilman, 2001). This project is designed to determine why OCS 
attendance is dropping, and to determine what can be done about it. 
Project Objectives: The objective of this project is to survey ARNG enlisted soldiers on (a) what barriers exist to 
their state OCS enrollment and (b) what specific actions/steps might be taken to boost future enrollment rates. 


Key Deliverables: Project deliverables include a work plan, the survey instrument, and a final report. 


Findings/Outcomes 
Report Citations: 
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DO# 0039 Title: Analysis of why FORSCOM and TRADOC soldiers are Absent Without Leave 
AWOL) and Desert 


Program Area DO-COR: Dr. Bruce Bell 
QR X_ DO-ACOR: 
Project Director: Dr. Peter Ramsberger 


Status: Ongoing (January 16, 2002-October 15, 2002 


Background: The Army has experienced an increase in the number of soldiers going AWOL and subsequently 
being Dropped From Rolls (DFR). Consequently, there is an interest in understanding the roots of this phenomenon, 
how it can be abated, and what means might be taken to retain soldiers who desert. 
Project Objectives: Under this delivery order, we will develop surveys to be administered to soldiers who desert 
and are returned to military control and their immediate supervisors. These questionnaires will solicit information 
about why the soldier deserted, what warning signs were present if any, what steps were taken to ameliorate the 
problem(s) that led to the decision to leave, and what steps might be taken to retain the solider in the Army. In 
addition to providing information to the Army about these issues, the surveys will be refined so that data ¢ can 
continue to be collected over time. 
Key Deliverables: Deliverables in the deserter surve : 
Findings/Outcomes: A literature review was completed and is being published as an ARI special report. The draft 
surveys have been developed and the leader survey is being pilot tested. A legal opinion was sought regarding 
surveying deserters prior to adjudication of their cases, which can sometimes be delayed for months after they are 
returned to military contro]. The judgment returned was that we could only do a survey that is completely 
anonymous; otherwise we would be asking the individual to provide information that could be used against him in a 
court martial. This has required the retooling of the methodology, with alternative courses of action currently under 
investigation. 
Report Citations: 
Ramsberger, P. F., & Bell, D. B. (2002). What we know about AWOL and desertion: A review of the professional 
literature for policy makers and commanders (Special Report 51). Alexandria, VA: U.S. Army Research Institute for 
the Behavioral and Social Sciences. 
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DO# 0040 Title: New Predictors for Selectin ning Objective Force Soldiers 


Program Area DO-COR: Dr. Trueman Tremble 
QR __ DO-ACOR: 


AOS __ Project Director: Dr. Deirdre Knapp 
MT xX 


Status: On going (February 15, 2002 — August 15, 2003 


Background: The U.S. Army is undertaking fundamental changes to transform into the Objective Force. This 
transformation will involve development and fielding of Future Combat Systems (FCSs) to achieve full spectrum 
dominance through a force that is responsive, deployable, agile, versatile, lethal, and fully survivable and sustainable 
under all anticipated combat conditions. However, Army leadership recognizes first and foremost the importance of 
its people — soldiers — to the effectiveness of transformation. In this regard, the Army is diligently seeking to ensure 
Army transformation into the future through soldier and unit training, leader development, and the preparedness of 
soldier systems. 

The current project (Select21) concerns soldier selection, with the goal of ensuring the Army acquires soldiers 
with the knowledges, skills, and attributes (KSAs) needed for performance of the types of tasks envisioned in a 
transformed Army. The ultimate objectives of the Select21 research program are to (a) develop and validate 
measures of critical attributes needed for successful execution of future Objective Force missions and (b) propose 
use of the measures as a foundation for an entry-level selection and classification system adapted to the demands of 
the 21" century. This intended to be at least a 4-year research program, the first 18 months of which are covered 
under this delivery order. 

Project Objectives: The objectives specific to this initial contract are to (a) develop a plan for the overall research 
program; (b) identify relevant job clusters to include in the research; (c) forecast Army-wide and cluster-specific job 
requirements and associated knowledges, skills, and aptitudes (KSAs); and (d) recommend predictor and criterion 
measures to use in a subsequent criterion-related validation investigation. 
Key Deliverables: Key deliverables include (a) a set of job clusters suitable for supporting the research questions, 
(b) performance demands for future first-term soldiers (Army-wide and for selected sets of MOS), (c) KSAs required 
of future first-term soldiers (Army-wide and for selected sets of MOS), and (d) a start on the development of KSA 
(predictor) measures that have potential for improving the selection and classification of future first-term soldiers 
the predictors. 


Findings/Outcomes: 


Report Citations: 
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DO# 0041 Title: Reducing Advanced Individual Training (AIT) to Less than 26 Weeks 


Program Area DO-COR: Dr. Kelly Ervin 

QR XxX __ DO-ACOR: 

AOS Project Director: Ms. Charlotte Campbell 
MT 

Status: Ongoing (May 6, 2002 - February 5, 2003 


Background: Advanced Individual Training (AIT) is the Army’s first opportunity to provide job-specific training to 
newly enlisted soldiers. Depending on the military occupational specialty (MOS), AIT may run for 26 weeks or 
longer. The concern is that this extended period of training prior to actual job assignment may cause soldiers to 
become unmotivated, experience skill retention problems, or “burn out” on classroom instruction. To address these 
concerns, the U.S. Army Training and Doctrine Command (TRADOC) needs to know whether soldiers in AITs that 
are 26 weeks or longer are experiencing these or other types of problems that could be remedied by reducing course 
length. Additionally, TRADOC needs to know whether it makes sense, given soldier performance requirements on 
the job, to reduce these courses to less than 26 weeks, and if so, how. This delivery order is intended to help address 
this need. 
Project Objectives: The objectives of this project are to detemine (a) if soldiers’ proficiency on skills trained in AIT 
is diminished once the soldiers complete a lengthy AIT course and join their first unit and (b) if training for 
particular tasks is best offered during or after AIT. 


Key Deliverables: Project deliverables will include an analysis database and a written study report. 


Findings/Outcomes 
Report Citations: 
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Appendix A 
ARI COMPRS-II Program Descriptions 


Quick Reaction (QR) Program 


Applicable Areas. The QR program is intended to give ARI a quick-response capability to 
perform short-term research or studies and analysis dealing with manpower and personnel issues 
for which the necessary in-house capability is not available. The QR Program may only be used 
for the procurement of non-personal services to perform the tasks specified in the DO, subject to 
the limitations set forth below. 


Conditions. Because this program is intended to resolve manpower and personnel issues 
that can be studied in a short time, the following conditions will normally apply: 


e Each of the QR Program DOs shall be completed within the period of time specified 
in the DO, with the maximum allowable completion normally being within a 12- 
month period from the date of the DO. 


e Each task of the DO shall be completed by HumRRO or its subcontractor within the 
total time allocated and a final report prepared and delivered. 


e Unless otherwise stated in the DO, the tasks to be performed by the Contractor shall 
include a meeting with ARI at Alexandria, Virginia or at an ARI Field Unit at the start 
of, and at the completion of, each of the QR Program DOs. 


Attitude and Opinion Survey (AOS) Program 


Applicable Areas. The AOS program is intended to give ARI the ability to conduct 
surveys to provide information for accession and force management decision-making. This 
information can only be obtained through surveys of the target populations and may require 
updating due to changing population dynamics and attitudes in the various population segments. 


Conditions. Because this program is intended to provide information quickly to resolve 
manpower and personnel issues, the following conditions shall normally apply: 


e Each of the AOS efforts shall be completed within the period of time specified in the 
DO, with the maximum allowable completion normally being within a 12-month per- 
iod of the date of the DO or an 18-month period if Office of Management and Budget 
(OMB) approval is required. Each AOS survey shall be performed using standard 
random sampling procedures or other appropriate sampling techniques. 


e The tasks written by the Government in each AOS Program SOT shall include a 
statement of the target group for the survey. A target group may be defined as, for 
example, all males, age 16-21 years old, in high school or graduated, and having 
positive propensity to enlist in any military service. The Contractor shall prepare as 
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part of its response to the SOT, the necessary screening and sampling methodologies 
to assure that the target group requirements are met. 


If specified in the SOT and subsequent DO, the Contractor shall prepare a survey 
instrument. The Government may, at its discretion, construct a proposed survey in- 
strument and submit it to the Contractor for review and recommended changes. The 
approved survey instrument shall be administered by the Contractor to the target 
population, or a sample thereof. All reproduction, survey administration, analysis, and 
report generation costs shall be included in the Contractor's RFDO for an AOS 
survey. 


The ability to conduct surveys under the AOS program may depend on ARI obtaining 
OMB approval to collect the information from the public. If OMB approval is 
required, and if such approval is not obtained, the survey shall not be conducted. The 
Contractor will be notified by the Government of the status of OMB approval. 
Surveys involving military personnel do not require OMB approval. ARI will make 
the determination of approval authority prior to an SOT being issued and will clearly 
state in the SOT if survey administration is contingent upon any other approval 
authority. 


When the final survey instrument is received by the Government, it may be necessary 
for the DO COR to submit the survey instrument to OMB for approval. The approval 
process may require from four to six months. Part of the OMB submission is a de- 
tailed description of the sampling plan, including burden hours, sampling 
methodology, non-response analysis, etc. The Contractor shall prepare the necessary 
documentation in accordance with the SOT and DO requirements and submit it to the 
DO COR who will submit it through agency channels. 


Each DO task shall be completed by the Contractor within the time allocated and a 
final report delivered. The final report shall contain copies of any appropriate 
verbatim responses of survey participants. Unless otherwise stated in the DO, the 
tasks to be performed by the Contractor shall include a meeting with ARI in 
Alexandria, Virginia or other ARI Field Unit locations at the start of, and at the 
completion of, each AOS DO. 


At all times the contractor will protect the confidentiality of the survey responses. 


If OMB approval is not received, the Contractor will be paid only for those tasks in 
the DO which are completed, and which do not require an approved survey instru- 
ment. Each AOS DO will usually contain at least two phases as follows: 


Phase I: Preparation. The tasks under Phase | will be the review or development of 
survey instruments, sampling methodology, preparation of approval packet (if re- 
quired in the DO), and other items necessary for preparation of the survey admini- 
stration. 
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Phase II: Survey Administration, Analyses, and Reporting. Upon receipt of survey 
approval, Phase II will involve the tasks necessary to conduct the survey, compile 
and analyze the data, prepare reports, and conduct in-person presentation of 
results (if required in the DO). Phase II shall always be contingent upon receipt of 
proper approval. If such approval for the survey is not obtained, Phase II will not 
be authorized and no payment for any tasks under Phase II will be made to the 
Contractor. 


Medium-Term (MT) Program 


Applicable Areas. The MT Program is intended to give ARI the ability to conduct a 
limited number of research or studies and analysis efforts whose duration would not normally 
exceed 24 months after HumRRO receives a DO. The MT program may only be used for the 
procurement of non-personal services to perform the tasks specified in the DO, subject to the 
limitations set forth below. 


Conditions of MT Program. This program is intended to resolve problems associated with 
manpower and personnel issues which require a somewhat longer period of performance than the 


QR program. The following conditions shall normally apply: 


e Each of the MT efforts shall be completed within the period of time specified in the 
DO, with the maximum period normally being 24 months from the date of the DO. 


e Each task of the DO shall be completed by the Contractor within the total time 
allocated and a final report delivered. Unless otherwise stated in the DO, the tasks to 
be performed by the Contractor shall include a meeting with ARI, in Alexandria, 
Virginia or at ARI Field Units, at the start of, and at the completion of, each MT 
Program DO. 


